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Abstract 

Our  focus  is  the  simple  linear  regression  model  with  measuranent 
errors  in  both  variables.  It  is  often  stated  that  if  the  measurement  error 
in  x  is  "snail",  then  we  can  ignore  this  error  and  fit  the  model  to  data 
using  ordinary  least  squares.  There  is  seme  ambiguity  in  the  statistical 
literature  concerning  the  exact  meaning  of  a  "small"  error.  For  example. 
Draper  and  Smith  (1981)  state  that  if  the  measurement  error  variance  in  x 
is  snail  relative  to  the  variability  of  the  true  x's,  then  "errors  in  the 
x's  can  be  effectively  ignored",  see  Montgomery  &  Peck  (1983)  for  a  similar 
statement.  Scheffe  (1973)  and  Mandel  (1984)  argue  for  a  second  criterion, 
which  may  be  informally  summarized  that  the  error  in  x  should  be  small 
relative  to  (the  standard  deviation  of  the  observed  Y  about  the 
line)/ (slope  of  the  line).  We  argue  that  for  calibration  experiments  both 
criteria  are  useful  and  important,  the  former  for  estimation  of  x  given  Y 
and  the  latter  for  confidence  intervals  for  x  given  Y. 
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1.  Introduction 

There  is  substantial  literature  on  the  problem  of  precision  instrument 
calibration,  see  for  exanple  Sctief fe  (1973),  Rosenblatt  and  Spiegelman 
(1981)  and  Mandel  (1984).  We  will  focus  on  such  calibration  when  fitting  a 
straight  line  to  a  set  of  data  in  which  the  predictor  x  is  measured  with 
error. 

We  often  advise  on  calibration  problems,  and  recently  we  were  asked  to 
try  to  quantify  what  is  meant  by  a  "small”  measurement  error  in  x,  with  the 
idea  that,  if  such  error  were  small,  we  oould  safely  ignore  it  and  procede 
with  ordinary  least  squares  analysis.  In  trying  to  do  this  we  realized 
that  the  literature  is  somewhat  ambiguous,  and  in  fact  there  are  two 
distinct  criteria  used  to  decide  when  measurement  error  in  x  is  snail.  For 
example.  Draper  and  Smith  (1981,  page  124)  state  that  if  the  measuranent 
error  variance  in  x  is  snail  relative  to  the  variability  of  the  true  x's 
themselves,  then  "errors  in  the  x's  can  be  effectively  ignored  and  the 
usual  least  squares  analysis  performed".  This  comment  is  echoed  by 
Montgomery  and  Peck  (1982,  page  388).  On  the  other  hand,  both  Scheffe 
(1973,  page  2)  and  Mandel  (1984)  use  the  criterion  that  we  can  safely 
ignore  measurement  error  in  x  if  its  standard  deviation  is  snail  relative 
to  the  ratio 


Standard  deviation  of  measured  Y  about  the  line. 


Slope  of  the  line 


i 


& 


hr 


The  authors  were  working  in  different  contexts,  so  it  is  not  surprising 


that  their  criteria  differ. 

In  this  paper,  we  point  out  that  for  calibration  experiments  both 
criteria  are  useful.  The  criterion  used  by  Draper  and  Smith  is  appropriate 
when  the  goal  is  estimation  of  intercept  and  slope  based  on  the  calibration 
data  set,  and  then  at  the  second  stage  for  estimating  the  true  value  of  x 
fran  a  new  observed  Y.  The  criterion  of  Scheffe  and  Mandel  addresses  the 
issue  of  confidence  intervals  for  estimating  x  fran  an  observed  Y.  If  the 
Draper  and  Smith  criterion  is  satisfied  while  that  of  Scheffe  and  Mandel  is 
not,  the  effect  of  ignoring  the  measurement  error  in  x  is  essentially  to 
cause  larger  confidence  intervals  for  estimating  the  true  value  of  x  from 
new  observed  Y  than  is  necessary. 

Suppose  that  observed  responses  {Y^ }  are  related  linearly  to  the  true 
working  standards  {x^ }  through  the  equation 

(1.1)  Yj^  =  at  +  flXj^  +  6^^  ,  i  -  1,2, ...N  . 

Here  the  deviations  combine  measurement  errors  in  the  response  math 

equation  or  model  error,  and  the  {€^}  sure  normally  distributed  with  mean 

.  2 

zero  and  common  variance  o-g  . 

Rather  than  observing  the  true  working  standards  (x^>,  we  observe 

(1.2)  xi  *  xi  +  vL 

where  the  measurement  errors  {v^}  are  assumed  normally  distributed  with 

2 

mean  zero  and  variance  o-m  .  In  the  terminology  of  Puller  (1986),  the 
equation  (1.1)  includes  both  equation  error  and  response  measurement  error. 
Fran  now  on,  when  we  speak  of  measurement  error  we  will  mean  measurenent 
error  in  the  true  {x^}. 


Assuming  the  world ng  standards  {x^>  are  measured  without  error,  one 
would  often  procede  as  follows.  First,  perform  the  usual  least  squares 

AAA 

analysis,  which  yields  estimates  (o^,  BL,  o-L>.  A  new,  independent 
observation  Y*  is  then  made,  and  the  goal  is  to  estimate  the  value  of  x* 


such  that 


E  Y*  *  or  +  fl  x* 


The  maximum  likelihood  estimator  is 

(1-3)  **  *  <**  “  <V/\  • 

For  confidence  intervals,  the  Working-Hotelling  100 (1— or )  %  interval 
(Seber  (1977))  for  the  unknown  x*  is 


(1.4) 


I  *  {x:  Y#  6  +  8l  x  +  t  o-L  R(x)>  , 


where  t  is  the  l-ac/2  percentage  point  of  the  t-distribution  with  N-2 
degrees  of  freedom,  and 

R2(x)  *  1  +  N_1(l  +  (x-x)2/s2>  , 

-  2 

where  x,  sx  are  given  by 

_  _i  N  2  -1  ^  -  2 

x  =  N  x  x.  ,  s*  =  N  A  (x  -  x)  . 

1  l  x  x 

If  the  calibration  is  to  be  repeated,  more  complex  confidence  statements 
are  available  for  those  who  wish  to  use  them,  see  Scheffe  (1973). 

Draper  and  Smith's  criterion  for  the  severity  of  measurement  error  is 


(1.5) 


measurement  error  variance  in  the  {x. )  o- 
_ _ i_  ^ _ m 

2 

Variation  of  the  (x. )  s 


Scheffe  and  Mandel  propose  that  the  severity  of  measurement  error  depends 


on  the  size  of 


.'o 


(1.6) 


<^«V»2 


In  the  next  section  we  discuss  the  criteria  (1.5)— (1.6)  with  regard  to 
estimation  and  confidence  intervals  for  x*  given  an  observed  Y*. 


The  Effect  of  Small  Error 


Let  and  denote  the  large  sample  mean  and  variance  of  the  true 


working  standards  {x^ } ,  which  cure  measured  with  variance  o-jjj.  For  large 
samples,  the  criterion  (1.5)  can  be  written  as 
(2.1)  X 


*1/4  • 


and  least  squares  estimates  (acL,  8^)  converge  in  probability  to 


(at  +  X  pxfl/(l+X)»  fl/(l+X)>  respectively.  By  centering  appropriately  so 


that  px  10,  we  see  that  the  bias  in  least  squares  essentially  depends  on 


the  size  of  X  in  (2.1).  When  X  is  small,  for  the  purpose  of  estimation, 
the  effect  of  ignoring  measurement  error  in  the  true  (x^>  is  slight. 

Let  us  suppose  that 

(2.2) 

is  known.  From  Kendall  &  Stuart  (1961,  pages  375-387),  the  maximixn 
likelihood  estimators  of  (at,8,o-)  are  given  by 
*  Y  -  a*  X 


6  - 


a*  - 


(s2  -  e"1  s£)  +  us2  -  e'1  s2)2  +  48"1 


2  Syx 


*  «'1|SX  -  W**1' 


'  '  '  '  cV  V'  V 


sw  =  -  /  (X.-XMY.-Y)  . 

H  Hh  1  1 

1*1 

It  is  known  that  the  naximun  likelihood  estimator  for  o  is  biased  even  in 
larger  samples,  and  it  is  customary  to  make  the  correction 

A  A 

O-  *  =  2  o  . 
m*  m 

When  \  is  small,  not  only  are  the  least  squares  estimators  nearly  the  same 
as  the  maximum  likelihood  estimators,  but  in  particular  the  least  squares 
estimators  are  approximately  unbiased  as  discussed  previously.  The  story 
is  considerably  different  vfaen  we  turn  to  confidence  intervals.  Define 
*  length  of  the  confidence  interval  for  x*  given  Y*  taking 
into  account  the  measurement  error  in  {x^}. 

L2  *  length  of  the  confidence  interval  for  x*  ignoring  the 
measurement  error  in  the  {x^}. 

Then,  for  large  enough  sample  sizes,  in  Appendix  A  we  verify  that  when  \ 
is  (2.1)  is  small  the  ratio  of  these  lengths  is  approximately 

—  :  u  +  (o-yto-g/B))2}*  . 


(2.3) 


Equation  (2.3)  verifies  the  criterion  of  Scheffe  and  Mandel  that  for 

confidence  intervals,  we  can  ignore  measurement  error  in  the  working 

2 

standards  only  if  the  measuranent  error  has  variance  o-  snail  relative  to 

2  2 

o-g/a  .  In  the  next  section  we  provide  an  example  vrtiere  the  criterion 
(1.5)  mentioned  by  Draper  &  Smith  is  small  but  the  Scheffe  and  Mandel 
criterion  (1.6)  is  large. 

3.  An  Example 

In  Table  1  we  list  a  subset  of  the  data  investigated  by  Lechner,  Reeve 
&  Spiegelman  (1982).  It  is  not  our  purpose  to  provide  a  definitive 
analysis  of  these  data.  Rather,  we  use  the  data  only  to  provide  a  means  of 
exploring  the  effect  of  ignoring  small  measurement  error,  especially 
through  the  increased  length  ratio  (2.3).  We  assume  a  straight  line  fit 

A  A  A 

(1.1)  to  the  data.  We  find  that  <*L  =  -291.49,  BL  =  2346.64  and  o-L  =  1.64. 
Fran  discussion  with  the  investigators  it  was  thought  that  o-m  and  o-g  cure 
of  the  same  order  of  magnitude.  However,  since  o-g  is  made  up  of  both 
response  measurement  error  and  equation  error,  we  decided  to  be  rather 
conservative  and  set  0  *  0.001  in  (2.2).  We  then  used  the  rough 
approximations 

0  :  fl*  =  2346.64  o-g  =  (1000)*o-m  :  0.0214 

o-  I  o-  .  a  6.77  x  10  4 
m  m* 

2  2 
s  2  sample  variance  of  -o-  2  0.57  . 

x  observed  X's 


-  9  - 


obtaining  therefore  that  \  <  0.001. 

A  A 

Clearly,  \  is  extremely  small  and,  as  expected,  8*  I  fiL  .  This  leads 
to  the  conclusion  that  for  purposes  of  estimation,  measurement  error  in  the 
{x^}  can  be  effectively  ignored.  However,  the  ratio  of  the  lengths  of  the 
confidence  intervals  for  x*  is  approximately 

;  (i  +  e  a2)*  :  74.2  . 

This  large  ratio  emphasizes  our  point  that  the  definition  of  "snail 
measurement  error"  must  depend  on  vrtiether  one  is  interested  in  estimation 
or  confidence  intervals. 

4.  Conclusion 

We  have  shewn  that,  under  the  ideal  conditions  of  a  straight  line 
model  and  a  fairly  large-sized  war  king  sample,  ignoring  measurement  errors 
in  x  which  are  "small"  relative  to  the  usual  estimation  criterion  (2.1)  can 
result  in  calibration  confidence  inter  Veils  vtfiich  are  much  larger  than 
necessary.  For  confidence  intervals,  it  is  more  sensible  to  judge 
measurement  error  size  on  the  basis  of  both  (1.5)  and  (2.3).  Ignoring  the 
measurement  error  in  the  true  working  standards  {x^>  will  cause  an  increase 
in  confidence  interval  length  on  the  order  of  (2.3). 

We  finish  by  emphasizing  that  using  measurement  error  techniques  to 
obtain  shorter  calibration  confidence  intervals  requires  that  equation 
(l.l)  should  hold.  While  least  square  confidence  intervals  can  be  very 
conservative  in  examples  such  as  we  have  studied,  they  are  more  robust 
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Appendix  A 

In  this  appendix,  we  verify  the  approximation  (2.3).  While  a  precise 
large- sample  analysis  is  routine,  it  is  also  notationally  quite  cumbersome. 
The  essential  ideas  sure  perhaps  easier  to  understand  through  the  following 
heuristic  analysis.  Suppose  that  N  is  large  and  that  \  in  (2.1)  is  stall. 
Assuming  that 

(A.  1)  o-^/o-g  -  9  known, 

A  A 

then  maximun  likelihood  estimates  (at*,  fiA)  can  be  formed  which  are 
consistent  for  («,8),  see  Fuller  (1986).  Under  the  assunption  of  small  \ 
and  large  sample  size  N,  we  have 

A  A  A  A 

*L  1  1  flL  -  -  fl  ? 

*  -  2  2  2  4 

R(x)  I  1;  o*ro*  Z  o-^»  o-^  Z  (o-g  -t  8  o-m>*  * 

A 

Here  o-  *  is  the  usual  consistent  estimate  of  ov.  under  the  assunption 
m  t 

A 

(2.2).  Taking  into  account  the  measurement  error  in  {x^}  and  using  (a*, 

A  A 

8*,  o-  *),  within  our  heuristic  framework  the  appropriate  Working-Hotelling 
nr 

confidence  interval  for  xA  is  approximately 

h  m  {x:  Y*  6  i  z«  °m*>  ' 

where  z^,  is  the  l-<x/2  standard  normal  percentage  point.  The  usual 

interval  formed  by  ignoring  measurement  error  is  approximately 

I2  “  {xs  Y*  6  *l  +  ®L  x  i  z«  °’L)  * 

This  latter  interval  is  strictly  appropriate  not  for  x*  but  rather  for 

X*  =  x*  +  v  .  The  length  of  the  confidence  interval  1^  taking  into  account 


measurement  error  in  {x^}  is,  for  large  samples,  proportioned  to 
(A. 2)  Li  :  2  o-g/fl 

while  that  for  the  usual  least  squares  analysis  is  proportional  to 
(A. 3)  L  '  2  z  (o-*  +  fl2  o-M/8  • 

2  <X  fc  Rl 

The  ratio  of  these  lengths  is,  noting  (A.1), 

r  :  <1  +  “V«Vs»V  . 


(A.  4) 


Pressure  Tank  Calibration  Data 


X 

2.08406 

2.08411 

2.27272 

2.27302 

2.27340 

2.46295 

2.46313 

2.65154 

2.65191 

2.65216 

2.84196 

2.84205 

3.03029 

3.03084 

3.03108 

3.22096 

3.22114 

3.40919 

3.40977 

3.40994 

3.59999 

3.60028 

3.78805 

3.78871 

3.78883 

3.97893 

3.97932 

4.16693 

4.16762 

4.16781 

4.35790 

4.35825 

4.54579 

4.54660 


Y 

4599.3 

4600.1 

5044.1 

5042.7 

5044.3 

5488.1 

5486.5 

5931.1 

5931.5 

5931.6 

6379.7 

6379.8 

6817.5 

6817.3 

6817.9 

7266.4 

7268.3 

7709.3 

7709.6 

7710.5 

8155.5 

8157.5 

8597.2 

8599.1 

8600.3 

9048.4 
9047.8 

9484.2 

9486.6 

9486.6 

9935.5 

9938.3 
10377.0 

10378.6 


